Divisive inhibition in recurrent networks.
نویسندگان
چکیده
Models of visual cortex suggest that response selectivity can arise from recurrent networks operating at high gain. However, such networks have a number of problematic features: (i) they operate perilously close to a point of instability, (ii) small changes in synaptic strength can dramatically modify the degree of amplification, and (iii) they respond slowly to rapidly changing stimuli. Divisive inhibition, acting through interneurons that are themselves divisively inhibited, can solve these problems without degrading the selectivity of a recurrent network.
منابع مشابه
Gain control through divisive inhibition prevents abrupt transition to chaos in a neural mass model.
Experimental results suggest that there are two distinct mechanisms of inhibition in cortical neuronal networks: subtractive and divisive inhibition. They modulate the input-output function of their target neurons either by increasing the input that is needed to reach maximum output or by reducing the gain and the value of maximum output itself, respectively. However, the role of these mechanis...
متن کاملDivisive Normalization , Line AttractorNetworks and Ideal
Gain control by divisive inhibition, a.k.a. divisive normalization, has been proposed to be a general mechanism throughout the visual cortex. We explore in this study the statistical properties of this normalization in the presence of noise. Using simulations, we show that divisive normalization is a close approximation to a maximum likelihood estimator, which, in the context of population codi...
متن کاملDivisive Normalization, Line Attractor Networks and Ideal Observers
Gain control by divisive inhibition, a.k.a. divisive normalization, has been proposed to be a general mechanism throughout the visual cortex. We explore in this study the statistical properties of this normalization in the presence of noise. Using simulations, we show that divisive normalization is a close approximation to a maximum likelihood estimator, which, in the context of population codi...
متن کاملExtending Network Normalization Schemes
Normalization techniques have only recently begun to be exploited in supervised learning tasks. Batch normalization exploits mini-batch statistics to normalize the activations. This was shown to speed up training and result in better models. However its success has been very limited when dealing with recurrent neural networks. On the other hand, layer normalization normalizes the activations ac...
متن کاملGain control with A-type potassium current: IA as a switch between divisive and subtractive inhibition
Neurons process and convey information by transforming barrages of synaptic inputs into spiking activity. Synaptic inhibition typically suppresses the output firing activity of a neuron, and is commonly classified as having a subtractive or divisive effect on a neuron’s output firing activity. Subtractive inhibition can narrow the range of inputs that evoke spiking activity by eliminating respo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Network
دوره 11 2 شماره
صفحات -
تاریخ انتشار 2000